Multidirectional mappings and the concept of a mental syllabary in a neural model of speech production
نویسندگان
چکیده
As a result from modeling cortical processes of self-organization occuring during speech acquisition, a comprehensive neural model of speech production has been developed by using self-organizing neural networks and feedforward neural networks. This model is capable of generating acoustic speech signals and sensory feedback signals by using a high quality 3-dimensional articulatory-acoustic speech synthesizer as a front-end device. A mental syllabary forms the central layer within this model. The mental syllabary comprises a heap of neural SOM layers (phonetic map) which can be interpreted as a system of mirror neurons coactivating phonemic, sensory, and motor states of a syllable under production (feed-forward control). Feedback control is modeled by comparing the current sensory feedback state produced by the articulatory-acoustic model with the prestored sensory state (efference copy), activated during feedforward control via the mental syllabary. This model can be integrated easily as a phonetic part within a more general linguistic model of speech production.
منابع مشابه
Learning to associate speech-like sensory and motor states during babbling
Background: Development of the feedback loop of speech production starts during the babbling phase of speech acquisition. Within the first year of lifetime toddlers acquire the ability of imitating auditory stimuli, i.e. they acquire the ability of associating speech-like sensory and motor states. Method: Self-organizing maps and one-layer feed-forward networks were used for modeling this learn...
متن کاملEffects of syllable frequency in speech production.
In the speech production model proposed by [Levelt, W. J. M., Roelofs, A., Meyer, A. S. (1999). A theory of lexical access in speech production. Behavioral and Brain Sciences, 22, pp. 1-75.], syllables play a crucial role at the interface of phonological and phonetic encoding. At this interface, abstract phonological syllables are translated into phonetic syllables. It is assumed that this tran...
متن کاملJapanese mental syllabary and effects of mora, syllable, bi-mora and word frequencies on Japanese speech production.
The present study investigated the existence of a Japanese mental syllabary and units stored therein for speech production. Experiment 1 compared naming latencies between high and low initial mora frequencies using CVCVCV nonwords, indicating that nonwords with a high initial mora frequency were named faster than those with a low frequency initial mora. Experiments 2 and 3 clarified the possibi...
متن کاملMental Timeline in Persian Speakers’ Co-speech Gestures based on Lakoff and Johnson’s Conceptual Metaphor Theory
One of the introduced conceptual metaphors is the metaphor of "time as space". Time as an abstract concept is conceptualized by a concrete concept like space. This conceptualization of time is also reflected in co-speech gestures. In this research, we try to find out what dimension and direction the mental timeline has in co-speech gestures and under the influence of which one of the metaphoric...
متن کاملNeural models of speech production and speech acquisition
Neural models of sensorimotor control of speech production are rare. One current approach is the model given by Guenther (2006 and Guenther et al. 2006). Following the ideas of Guenther a comprehensive neural model of speech production using self-organizing neural networks can be given (Kröger et al. 2006a and 2006b). Both approaches simulate early processes of speech acquisition (babbling and ...
متن کامل